24 research outputs found

    Analog Realization of Arbitrary One-Dimensional Maps

    Get PDF
    An increasing number of applications of a one-dimensional (1-D) map as an information processing element are found in the literature on artificial neural networks, image processing systems, and secure communication systems. In search of an efficient hardware implementation of a 1-D map, we discovered that the bifurcating neuron (BN), which was introduced elsewhere as a mathematical model of a biological neuron under the influence of an external sinusoidal signal, could provide a compact solution. The original work on the BN indicated that its firing time sequence, when it was subject to a sinusoidal driving signal, was related to the sine-circle map, suggesting that the BN can compute the sine-circle map. Despite its rich array of dynamical properties, the mathematical description of the BN is simple enough to lend itself to a compact circuit implementation. In this paper, we generalize the original work and show that the computational power of the BN can be extended to compute an arbitrary 1-D map. Also, we describe two possible circuit models of the BN: the programmable unijunction transistor oscillator neuron, which was introduced in the original work as a circuit model of the BN, and the integrated-circuit relaxation oscillator neuron (IRON), which was developed for more precise modeling of the BN. To demonstrate the computational power of the BN, we use the IRON to generate the bifurcation diagrams of the sine-circle map, the logistic map, as well as the tent map, and then compare them with exact numerical versions. The programming of the BN to compute an arbitrary map can be done simply by changing the waveform of the driving signal, which is given to the BN externally; this feature makes the circuit models of the BN especially useful in the circuit implementation of a network of 1-D maps

    Reinforcement learning approaches for the stochastic discrete lot-sizing problem on parallel machines

    Get PDF
    This paper addresses the stochastic discrete lot-sizing problem on parallel machines, which is a computationally challenging problem also for relatively small instances. We propose two heuristics to deal with it by leveraging reinforcement learning. In particular, we propose a technique based on approximate value iteration around post-decision state variables and one based on multi-agent reinforcement learning. We compare these two approaches with other reinforcement learning methods and more classical solution techniques, showing their effectiveness in addressing realistic size instances

    Reinforcement Learning Applied to Trading Systems: A Survey

    Full text link
    Financial domain tasks, such as trading in market exchanges, are challenging and have long attracted researchers. The recent achievements and the consequent notoriety of Reinforcement Learning (RL) have also increased its adoption in trading tasks. RL uses a framework with well-established formal concepts, which raises its attractiveness in learning profitable trading strategies. However, RL use without due attention in the financial area can prevent new researchers from following standards or failing to adopt relevant conceptual guidelines. In this work, we embrace the seminal RL technical fundamentals, concepts, and recommendations to perform a unified, theoretically-grounded examination and comparison of previous research that could serve as a structuring guide for the field of study. A selection of twenty-nine articles was reviewed under our classification that considers RL's most common formulations and design patterns from a large volume of available studies. This classification allowed for precise inspection of the most relevant aspects regarding data input, preprocessing, state and action composition, adopted RL techniques, evaluation setups, and overall results. Our analysis approach organized around fundamental RL concepts allowed for a clear identification of current system design best practices, gaps that require further investigation, and promising research opportunities. Finally, this review attempts to promote the development of this field of study by facilitating researchers' commitment to standards adherence and helping them to avoid straying away from the RL constructs' firm ground.Comment: 38 page

    Prevalence, associated factors and outcomes of pressure injuries in adult intensive care unit patients: the DecubICUs study

    Get PDF
    Funder: European Society of Intensive Care Medicine; doi: http://dx.doi.org/10.13039/501100013347Funder: Flemish Society for Critical Care NursesAbstract: Purpose: Intensive care unit (ICU) patients are particularly susceptible to developing pressure injuries. Epidemiologic data is however unavailable. We aimed to provide an international picture of the extent of pressure injuries and factors associated with ICU-acquired pressure injuries in adult ICU patients. Methods: International 1-day point-prevalence study; follow-up for outcome assessment until hospital discharge (maximum 12 weeks). Factors associated with ICU-acquired pressure injury and hospital mortality were assessed by generalised linear mixed-effects regression analysis. Results: Data from 13,254 patients in 1117 ICUs (90 countries) revealed 6747 pressure injuries; 3997 (59.2%) were ICU-acquired. Overall prevalence was 26.6% (95% confidence interval [CI] 25.9–27.3). ICU-acquired prevalence was 16.2% (95% CI 15.6–16.8). Sacrum (37%) and heels (19.5%) were most affected. Factors independently associated with ICU-acquired pressure injuries were older age, male sex, being underweight, emergency surgery, higher Simplified Acute Physiology Score II, Braden score 3 days, comorbidities (chronic obstructive pulmonary disease, immunodeficiency), organ support (renal replacement, mechanical ventilation on ICU admission), and being in a low or lower-middle income-economy. Gradually increasing associations with mortality were identified for increasing severity of pressure injury: stage I (odds ratio [OR] 1.5; 95% CI 1.2–1.8), stage II (OR 1.6; 95% CI 1.4–1.9), and stage III or worse (OR 2.8; 95% CI 2.3–3.3). Conclusion: Pressure injuries are common in adult ICU patients. ICU-acquired pressure injuries are associated with mainly intrinsic factors and mortality. Optimal care standards, increased awareness, appropriate resource allocation, and further research into optimal prevention are pivotal to tackle this important patient safety threat

    Reducing the environmental impact of surgery on a global scale: systematic review and co-prioritization with healthcare workers in 132 countries

    Get PDF
    Abstract Background Healthcare cannot achieve net-zero carbon without addressing operating theatres. The aim of this study was to prioritize feasible interventions to reduce the environmental impact of operating theatres. Methods This study adopted a four-phase Delphi consensus co-prioritization methodology. In phase 1, a systematic review of published interventions and global consultation of perioperative healthcare professionals were used to longlist interventions. In phase 2, iterative thematic analysis consolidated comparable interventions into a shortlist. In phase 3, the shortlist was co-prioritized based on patient and clinician views on acceptability, feasibility, and safety. In phase 4, ranked lists of interventions were presented by their relevance to high-income countries and low–middle-income countries. Results In phase 1, 43 interventions were identified, which had low uptake in practice according to 3042 professionals globally. In phase 2, a shortlist of 15 intervention domains was generated. In phase 3, interventions were deemed acceptable for more than 90 per cent of patients except for reducing general anaesthesia (84 per cent) and re-sterilization of ‘single-use’ consumables (86 per cent). In phase 4, the top three shortlisted interventions for high-income countries were: introducing recycling; reducing use of anaesthetic gases; and appropriate clinical waste processing. In phase 4, the top three shortlisted interventions for low–middle-income countries were: introducing reusable surgical devices; reducing use of consumables; and reducing the use of general anaesthesia. Conclusion This is a step toward environmentally sustainable operating environments with actionable interventions applicable to both high– and low–middle–income countries

    Artificial neural networks based on bifurcating recursive processing elements

    No full text
    This dissertation addresses the study of neural networks in which the processing elements are mathematically defined by parametric recursion functions and their activity can exhibit bifurcation between different dynamical modes; Bifurcating Recursive Processing Elements, their associated concepts and their associated set of tools provide an alternative framework for the field of artificial neural networks. Such a framework allows for the computation and coding of information with single action potential pulses (i.e., computation with time), and also contributes to the exploration of non fixed-point attractors, bifurcation, chaos, and non-linear dynamics as elements of neural modeling and neuro-like computation. A novel method for the electronic implementation of recursive processing elements is described, which is based on the embedment of arbitrary iterative maps in the operation of the PUTON (Programmable Unijunction Transistor Oscillator Neuron) integrate and fire model neuron. The generality of the presented method offers the possibility of flexible complex behavior in spiking model neurons, and also suggests that different computing models based on recursive elements can be implemented with such electronic hardware. The interaction between recursive processing elements is studied by developing the concept of parametric coupling, which is based on the dynamic modulation of the recursion functionality of the processing elements and allows for the exploration of controlled switching between several dynamical modes (i.e., chaotic orbits, fixed-point orbits, and diverse periodic orbits). Entropy and mutual information measures are used to quantify the complexity of activity and the flow of information between processing elements, while Limit Set Diagrams are introduced for the visualization of the dynamical states exhibited by populations of parametrically coupled recursive elements. A two-stage architecture is also explored in the study of networks facing spatio-temporal stimulation. The self-organization of populations of interacting processing elements into clusters and the switching from chaotic behavior to ordered behavior are studied. The use of such phenomena for the modeling of higher-level brain functions (such as feature binding and the search for dynamic attractors that are compatible with a given sensorial stimulation) is also suggested

    Artificial neural networks based on bifurcating recursive processing elements

    No full text
    This dissertation addresses the study of neural networks in which the processing elements are mathematically defined by parametric recursion functions and their activity can exhibit bifurcation between different dynamical modes; Bifurcating Recursive Processing Elements, their associated concepts and their associated set of tools provide an alternative framework for the field of artificial neural networks. Such a framework allows for the computation and coding of information with single action potential pulses (i.e., computation with time), and also contributes to the exploration of non fixed-point attractors, bifurcation, chaos, and non-linear dynamics as elements of neural modeling and neuro-like computation. A novel method for the electronic implementation of recursive processing elements is described, which is based on the embedment of arbitrary iterative maps in the operation of the PUTON (Programmable Unijunction Transistor Oscillator Neuron) integrate and fire model neuron. The generality of the presented method offers the possibility of flexible complex behavior in spiking model neurons, and also suggests that different computing models based on recursive elements can be implemented with such electronic hardware. The interaction between recursive processing elements is studied by developing the concept of parametric coupling, which is based on the dynamic modulation of the recursion functionality of the processing elements and allows for the exploration of controlled switching between several dynamical modes (i.e., chaotic orbits, fixed-point orbits, and diverse periodic orbits). Entropy and mutual information measures are used to quantify the complexity of activity and the flow of information between processing elements, while Limit Set Diagrams are introduced for the visualization of the dynamical states exhibited by populations of parametrically coupled recursive elements. A two-stage architecture is also explored in the study of networks facing spatio-temporal stimulation. The self-organization of populations of interacting processing elements into clusters and the switching from chaotic behavior to ordered behavior are studied. The use of such phenomena for the modeling of higher-level brain functions (such as feature binding and the search for dynamic attractors that are compatible with a given sensorial stimulation) is also suggested
    corecore